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(54) TlUe: NETWORK REVIEW AND ANALYSIS OF COMPUTER ENCODED SUiV^BS 
(ST) Abstract 



A network system for review and analysis of microscope 
slides and specimens which were originally computer encoded from 
a microscope (1). and viewing locatioits and events of interest 
on the slide. w\xh such information being stoied on a network 
file server (3). The data also includes informaUon legaiding the 
I manner m which the initial examination was conducted for quality 
control purposes. The computer endodcd informaUon is letricvablc 
ai all rcmoic locations of the network (either local or connected 
I ^^'"> supervisor review or for pathologist analysis 
I (I). The network is further constituted by microscope (8) sites 
having similar computer encoding devices attached thereto, which 
function, in this aspect, as computer terminals of the network. For 
enhanced analysis, the computer terminals have direct access to 
patient background informaUon, e.g.. such as from an HIS (hospital 
information system) (7) for simultaneous slide analysis review in 
relation to the medical history of the patient. 
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NETWORK REVIEW AND ANALYSIS OF COMPUTER ENCODED SLIDES 
FIELD OF THE INVENTION 

This invention relates to computerized review of computer 
encoded microscope slides after examination of specimens 
thereon, and particularly with respect to multi-site examination 
thereof . 



BACKORODMD OF THE INVENTION 

Various devices exist for use in the review of previously 
examined microscope slides for facilitated re -examination, as a 
quality control, and as a gauge with respect to the degree of 
reliability of initial slide examination test results. 

One of such devices and methods of re -examination is disclosed 
in the parent of the present application wherein an encoder 
device is described which retrievably provides computer encoding 
of positions of the slide which were examined initially. 
Movement of the microscope stage on which the slide is 
positioned correspondingly records position location on a 
computer generatable image of a slide. As a result, retrieval 
of the computer encoded examination provides a slide image 
having markings thereon which indicates areas of the slide which 
were examined (and the absence of which indicates areas which 
were not examined) . Co -pending application, serial no. 
08/4 91,414, filed June 16, 1995, provides a further enhancement 
for determining which areas were examined, for how long, whether 
there was overlapping of viewing, the percentage of the slide 
area screened and the like. In such co-pending application, a 
grayscale display is used to indicate relative dwell time at 
each location (or pixel of the computer representative image) , 
whereby during rapid screening, the central area of a moving 
circular cursor that sweeps out a track on the screen, is darker 
than the edges of the field of view. in addition, as a screener 
overlaps the column or row on the next pass, the time spent on 
the overlapping edges is added, and the edges darken to indicate 
additional inspection time. Based on variations in the 
grayscale, the device further provided the percentage of 
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.elds as a useful measure of screening performance, 
overlapping reviewers were able to use to 

Which screeners and --^^^ ^^^^^^ ^^3^,,^ „n lead to false 
refine P"^"/ ' ^^,,te' too .uch overlap indicates inefficient 
negative ,3 thereby provided with a ratxonal 

performance. A l^^^"^ ^,,Hod for choosing which 

. .he internal computer cloOc further enabled placement of 
use of the xntern manner such that a 

rte::!:::!^ co:id be made with respect to the examination 
dwell time in the examined areas. 

■ .in the parent application, selected marked 
- a further ^--/^ Z/^^;^, slide specimens were able to 

areas of specrfxed 1°^^*^^° fvisually or with audio) to 
be marked in computer memory ^^"^"^^^ of 
indicate whether such areas on --^determined coding, to 

particular interest -f//^^;°;,::Lg areas . Aa a result, the 
additionally marK ^^^^^ l^^^J^^ „„Kinga are thereby able 

areas having such ^^^^^^^f^ J^t,, location and re-location. 
CO be re-examined with greater e 

,.^»T-ate with actual imaging of slide 
Other systems extant, opera ^^^^ coupled with 

contents, such as with v-eo cam r ..d^^^^^ ^^^^^^^^ ^^^^^ 

slide location mapping for ret facility in 

of interest. -deo imageB a ^^^^^^^ 

computer storage and '^^^'^^^""^ ^ Procedures have been confined 

3Xide --examination s s ^^^^ .^^ge 

to a single site, and revie ^^^^terized review of the 

thereof, and. in -^^^/d oL-ining the initial results, 
encoded procedures utilized in 

SUMMARV OF THB THVENTION 

KS^ct of the present invention to provide 
, ,t is accordingly an ^^^^ ^^^^^^ informat:Lon 

LratredTrorr riide : —wi: 
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It is a further object of the present invention to provide such 
means for review at two or more networked remotely located 
microscope sites linked to computer encoder- terminals . 

It is yet another object of the present invention to permit the 
multiple review of flagged slide specimen view sites at two or 
more remotely located terminal sites » 

It is still yet another object of the present invention to 
provide network capaJDility at the terminal sites, for 
correlating slide information together with patient history 
and/or together with comparative observation information to 
resolve possible ambiguities in interpretation. 

It is another further object of the present invention to provide 
automatic location and review of the flagged slide specimen view 
sites. 

It is a still further object of the present invention to provide 
report generation in HIS (health information systems) systems 
for full patient records. 

These and other objects, features and advantages of the present 
invention will become evident from the following discussion and 
drawings in which: 

BRXEF DESCRIPTIOK OF THE DRAWINGS 

Figure 1 schematically depicts a networked system of microscope 
sites, with linked computer encoders; HIS network file servers- 
data supply system; and cytometer station; 

Figure 2 is a window field showing slide review, patient history 
and information and selected recorded images of the slide; 

Figure 3 is a report window field; and 

Figure 4 is a comparative window between patient slide and 
library-recalled slide image. 

3 
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* J for nBtwork. 

microscope ^thod relac to «lec 

specimen of the •^^';;;/„tUd, during prior .=an»x». 
t-"- "--,j;;„rTe or...naX examination --. -^^^ 

-rdrctr^ira^^ic.^^^^^^^^^^^ 

elide stage, on fj-f '^^^ ^^^cimen and the manner of 

encoding of effected by. correlation 

examination thereot computer means, wxth corr 

movement J/Z.tL.i.eXV record movement ^^/^"^.hie. 

„»icro9cope, to cor ^^^^ 3l,.de stag 

in an x-y direction P^^"^ \ ^^^i,,, locationB of the six 

b) recording movement . „f the specimen slxde. 

Lring the microscope by means of the 

stage ^-"J^^ ^^^.^„3 on the specimen ' ""i^e^^ctions . into 

at varxous locatx ^^^^t to programmed xn ^sxiant 

linked computer means, pu computer means, P 

c::puter storage /^^^fjctions automatically recorda. 

additional P-^^^r^TeLs , i^fo^ation relatxng tojhe^^^^ 
into the computer storag ^^^^^^ „^,,ch '^^^"'^^ 

-ored various -c-xon-^ ^^^^^^^^^ --^^e^lXendenriy 

.as -"'^-^/Z, J^o^puter storage means " in a 

of causing the c k ^ ^rate microscope s 

— - Te et.tion3%ompri.in, » --'-r,:::. 
network, each of tn microscope station 

computer means -;;^;;;t;„U to at le-t one computer mean. 
" "rente o'; recai.in. t.a .He .t».,. me.- 

3„„d —""•f.tion remote from the micro.cope u.ed 
for review at a i- 

„.,inal examination. ^^^^^^^^ ^ 

„ . preferred -%rrr;ecimen aiide and the manner 

n^ethod for network re 
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in which a prior microscope examination of the specimen slide 
was conducted, wherein selected details of the specimen of the 
specimen slide and the manner of examination thereof were 
computer encoded, during prior scanning examination thereof with 
a microscope having viewing means and a moving slide stage, on 
which the specimen slide was mounted, wherein encoding of the 
details of the specimen and the manner of examination thereof 
was effected by: 

a) operatively linking computer means, with correlation 
movement sensor means, to the movable slide stage of the 
microscope, to correlatively record movement of the. slide stage 
in an x-y direction plane in which the elide stage is movable; 

b) recording movement and various locations of the slide 
stage during the microscope examination of the specimen slide, 
at various locations on the specimen slide » by means of the 
linked computer means, pursuant to programmed instructions, into 
computer storage means; and wherein the computer means , pursuant 
to additional programmed instructions automatically records, 
into the computer storage mecuis, at the stored various 
locations, pre -determined indicia, with said indicia correlating 
to the microscope viewing area location on the specimen, and 
wherein said indicia, correlating to viewing area locations of 
interest were marked and recorded with a distinguishing marking 
for subsequent review recognition; said network reviewing method 
comprising the steps of: 

a) causing the computer storage means to be independently 
accessible by at least two separate microscope stations in a 
network, each of said stations comprising a microscope and 
computer viewing means, with each of said microscope stations 
being separately individually linked to at least one computer 
means capable of recalling said stored movements, locations and 
indicia from the storage means for review on the computer 
viewing means : 

b) recalling, at one or more of said microscope stations, 
from said computer storage means, a computer generated image of 
a slide with said indicia thereon, onto the viewing means of the 
respective microscope station, for review of the manner in which 
a prior microscope examination of the specimen slide was 
conducted; and 
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„r the respective microscope station. 
..e — ,Lther operative.y linked with the 
niicroscope thereat ^ ^.^^ n^ovement sensor means; 
computer n,eans, by corr ,,,,omitant specimen slide 

ii, moving '^^^^ ^^^f^;^ subsequent microscope viewing 

' ^'I'jr on the computer generated image, by indicator 
area with indicia on the P ^^^.^^ ^ distinguishing 

.eans. whereby <=-"/-^;^^; ^.,^^,e with the microscope, 
marking thereon is directly 

^he parent application, the present invention 
,0 With reference to the P^^""'^ ^^^^^ reviewing of a specimen 

also comprises a method ^J^J^''^''^^^^^ microscope examination of 
Slide and the manner m ^^^^^ selected details of 

specimen slide was <=-^-^^/^^^^^^^^%^e ^.,„er of examination 
the specimen of J^^^^X.^^uring prior scanning examination 
IS thereof were computer ^^^^^ J ^.^^.^^ ^eans and a moving 

.Hereof with a --^-^ splcimen slide was mounted, wherein 
Slide scage on .he manner of 

encoding of the aet ,-^_ted by: 

examination ---.^^"J^;V:.^J.. means, with correlation 

a) operatively ^^^J^l ^^^^^ ^lide stage of the 
movement sensor movement of the slide stage 

niicroscope. to correlat ively ^^^^^ ^^^^^ movable, 

in an x-y direction P^--%^^^;*^^"^^,,,3 locations of the slide 
b) recording movement and specimen slide. 

a...n, ..e Microscope c. ... 

a. various locations on '^>'' p,ogr.»m.d in«ructions, .n,:o 

li„K.d computer means, ^""^^^"^Jl^ compucer mean., pursuant 
computer scora., and an internal cloc. o. 

,o .aditional P-'^"""'^, "i»lly recordea. into the computer 
3 0 the oo»^.ut.r means, locations, pre -determined 

storage mean., at the «°"^7;^:^.l3 , determined by said 
indicia at P"'^'"""^"'^;^,;;.::, Torrel.tin, to the microscope 
internal cloC, -ith ="\^^''^'.:,L„. the predetermined t.m. 
viewing area location on '^'"^ „„elating to viewing area 

3, intervals, and wherein '-f "^^J^^^ and recorded with a 

location, o. --^-J^o: u^^e/. .eview ..cognition, said 

rwrtre^inrm"- - °" 
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a) causing the computer storage means to be independently 
accessible by at least two separate microscope stations in a 
network, each of said stations comprising a microscope and 
computer viewing means, with each of said microscope stations 
being separately individually linked to at least one computer 
means capable of recalling said stored movements, locations and 
indicia from the storage means for review on the computer 
viewing means: 

b) recalling, at one or more of said microscope stations, 
from said computer storage means, a computer generated image of 
a slide with said indicia thereon, onto the viewing means of the 
respective microscope station, for review of the manner in which 
a prior microscope examination of the specimen slide was 
conducted; and 

if indicia correlating to sites of interest have been 
marked with a distinguishing marking: 

i) placing the specimen slide on the movable slide stage of 
the microscope, at the respective microscope station, with the 

I microscope thereat being further operatively linked with the 
20 computer means, by correlation movement sensor means; 

ii) moving the stage, with concomitant specimen slide 
movement, with correlation of each subsequent microscope viewing 
area with indicia on the computer generated image, by indicator 
means, whereby correlated indicia having a distinguishing 
marking thereon is directly viewable with the microscope. 



25 



30 



The present invention includes a network system for review and 
analysis of computer encoded microscope slides and specimens 
which were originally computer encoded from a microscope 
(attached via an encoder device to a local computer site) , 
during an initial examination with an encoding system. The 
encoding includes parameters of viewing locations and events of 
interest on the slide, with such information being stored on a 
networked file server. The encoding also includes information 
regarding the manner in which the initial examination was 
35 conducted, for quality control purposes. The computer encoded 
information is retrievable at all remote locations of the 
network (either local or connected via modem) for supervisor 
review or for pathologist analysis. The network is further 
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. ilar computer encoding 

7Zle. terminals of the -^^f^^^^ ^..ient bacKground 

"r terminals have direct access t P information 
computer ter ^^^^ an HIS ^no v gelation to 

information. J^^^, ..i^e analysis J/,.pport . the 

for simultaneouB diagnostic suff 

system) for ^he patient- For 3 library of cell 

the medical networked with an on-lxne 

^„ter terminals are net ^^^^^ examinea. 

computer ^ comparison with the sJ-xa 

.ype images -f^,,,,,^^ with the orxg.nal ^^^^^^ 

diagnosis xs ei^e ^ ^^^^^^^ ^^^^^ . .h ^^^^^^^^ 

n^icroscope or wi cD-ROM and retrxevea 

si*^^^- arious required and 

..e following ^^^"^ r tL presen. invention: 
optional examination step 

, ) sofi£iffiSE_-5si££M^ . ^^.^ encoding system data is not 

^ m^isto communicate enco -^_ting microscopic 

providing means t i^ed for Means are 

, .seful unless means are ^^^^^^^ ^^^^Tate co-'P— 

slides that selecting appropriate co P 

--'"^^i:^^ ---^^^ — e^cirn s;s:em3 Who 

,or supervisor' or ^--^^^^^^^^ J^, interface to perform 
°rior slide examinations. ^ -^J^, encoding system- 

"Ji task is therefore an integral part 



30 



35 



„ -oc only on -f;/;^*"" °' 

«cric judgments are ^ . ^^iiv but on patxeni: 

Diagnostxc ^ microscopically r " decisions 

.pecifle cells "-"'^ '"^/,,„,„i hl...=rv. t„£or»..:lo» 
a Hospital Xn«o-.^^^ '^1;°- P"-"' 

r„rri:: a.alla.l. . co„p.ce. c,.».nal 
that the encoding system 
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for entry of patient: data, derived from observations of the 
slxde. directly into the Hospital Information System for 
immediate use by others. Such data can be numeric data from a 
differential cell count of a blood smear, urine specimen 
microbiology specimen or body fluid cytospin or it can be a 
cytologic or anatomic pathologic diagnosis text report. 

3) PlaoBQH tlQ Deoision SuppQT-t;« 

Diagnostic decisions, after observation of potentially 
pathologic cells on a specimen slide, are sometimes ambiguous 
even utxl.zing prior patient information. The pathologist will 
Often revxew xmages of cells by looking at other microLope 
order^o textbooJcs and images on 3 5mm filn. slides in 

reach a diagnoses. m accordance with the present invention the 
encoding system, is capable of supporting diagnostic decisions 
by retrxevxng i.ages from files and displaying them with the 
specimen cell in,ages digitized by means of a video camera. m 
addition, patient demographics and prior data entries are 
retrievable in the network, to suggest what should be observed 
on the microscope slide and what diagnoses may be possible. 

4) Report: Qenerat^-IoTt. 

Anatomic pathology or cytology diagnoses must be reported and a 
Sy™r"'Th'"°"'' venerated in the Hospital Information 

system Thxs report should include encoding system data such as 
maps of the location and types of unusual cells as well 
images of some of these cells digitized by means of a video 
camera. The encoding system data permits better document the 
loLT''^ . laboratory as well as providing images and cell 

locations for use during comparisons with cells from subsequent 
examinations, whereby it is possible to follow and documenr 
axsease progression. 

5^ fr?g«"'^< na Ingtnunenta ; 

Instruments for scanning specimens of cells on microscope 
slides, using a laser or a video camera, identify specific cells 
by their constituents, their genotype or phenotype, or their 
pathology. This type of instrument is used in medical and 
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f these instruments being 
research 1^^°"^°"^" "^^iHIln on the microscope slide of 
capable of recording ^^^^^^^^^s are interfaced, in accordance 
each cell measured. These ent invention, to an 

with a preferred embodiment of the pr 

encoding system in order: ^ ^^.^^ containing a 

to . cancer area) so that only these 

specific type of cell ,he instrument; or 

cells or the specxfxc instrument, the encoding 

3> after slides are s- ^ ^^^^ ^^^^^^^ ^^^^^^ 

3yste. can be -^^^f/L^.^ haaed oh properties found by 

include images of specixx 
the instrument. 

6) HMt o F'f'f^g t^eloratlont of pathologists, in a 

Xn order to minimize t.me ^^J^^J ^^^^^^ ^p.ised of a 
preferred embodiment, the relocation of annotated 

motorized stage. as a ^ 
elide areas is mechanized. 

Fia 1 is a diagram of the 
With reference .o the f^^l^ll^^^ll^^ ,„,oder system. One or 
preferred ^.ist ing of a microscope equipped with 

.ore encoders X. interfaced with a microprocessor, a 

stage position encoders, are ^^^^^ers are used by 

display screen and a Keyboard^ J^^^^e^iew microscope slides aa 
laboratory personnel to -/^^^/^^.^.^^ion. m accordance wxth 
described in the parenc of ^^^JJ^^^,,,^^ ^n additional 

Che present ^-^^^^^^^^^f ,„„3mitter and receiver chip 
circuit, such as a MAX491 ^^^^33,^.3 input/output 

connected directly to the ^ asynchronous line 

0 lines. Which enables ..d transmitter 

protocol using RS485 iin ^ running 

'chip are connected to a -;/;;Xg^nultiple encoders, with each 

throughout a ^-^^^^^'^^ Z l^^^rls . i.e.. "Daisy Chained", 
encoder being connected to the^^^ ^^^^^ ^^^^^ 

,5 The wires are ^^^^ ,„eoder DS Systems 4 and 

system UiN server. One o 

10 

SUBSTITUTE SHEET (RULE 28) 



wo 97/25678 



PCTAJS97/00748 



scanning instruments 5 may be connected to the network, provided 
that each uses a computer containing a network interface card, 
e.g., FASTCOM serial adapter board (Industrial Computer Source). 

Communication between the server and all encoders and other 
devices connected on the network wires 2 is effected by means of 
appropriate software with communication being in forms of 
packets having a defined structure. This structure contains the 
address of a device, a command or status byte, error control 
information and optionally a data field. Each communication on 
the network consists of the server sending a single packet to a 
particular device, the first byte of which is one device's 
address. The devices determine if the address corresponds to 
their address and only the one device with the correct address 
will receive the remainder of the packet. It will check for 
errors and respond with a single packet sent to the sez-ver. The 
server continually polls all devices to determine if any need to 
either send data to the server or to receive data from it. 

The server 3 of Figure 1 is a standard PC computer operating the 
encoder System network using the Microsoft Windows'" (3.1 or 95), 
NT or other similar operating system. Any commercially 
available Ethernet card can be inserted into a spare buss 
circuit board slot in the computer. The Ethernet card is in 
turn connected by wire 6 to any other computer with an operating 
system compatible with the Microsoft Windows operating system on 
the server. The encoder software utilizes an ODBC standard 
database structure to store and retrieve specimen data and 
patient demographics. Medical organizations are adopting 
standards such as HL7 to provide standard names of specific 
fields to be used in data files. By combining these standards 
it is possible for computer database programs of different 
systems to communicate with each other to either find or send 
specific items of data. 

With a Hospital Information System link, encoder users are able 
to retrieve specimen lists entered at an accession desk and use 
these to select the current specimen being examined as well as 
being able to call up and display patient demographics and 

11 
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■ „ Fi<,ure 1 the encoder DS .ub Sy«em comprisen a PC 
AS Shown in Figure i. ^.-Ive encoder software, 

computer 4 con£i9uxea with a CD-RO« drive en ^^^^^ 

Di.gno.is Decision Support '^^^^l' „„der stage 

fHe PC to a mxcroBCope equipped 

^„ J a rrn video camera o - 
position encoders and a CCD via 

= -1^ a database of tnicrophotographic 
.he co„ponent -"-^/'^^^ „'„,t: "nd high-power 

'""^'"cafior " atrorith.s to help direct the microscopic 

!!™ "r the Bp!cin,en, 3. expert co^entary on 
ex.,nination of the P „<,<^„a.ciona for further 

differential "^''^nosea vi ^„^„„j„,„,nemistry. special 

diagnostic P"'''^'^ medical references, and 5) 

stains. :;^^/r,^tIn, pathologists to capture, archive. 

^ images/cases. These components are 
preferably on CD-ROM disks. 

.he encoder DS System ^^-^^^^ ^^^^ 
pathologists in -^^f/fori'teLy in rapidly evolving area, of 
facilitates diagnostic consi , needle 

cycopathology specimen enhanced by 

aspiration. "crtterir and algorithm, for specimen 

providing more „p.„.date Knowledge about the 

"rtrrirus:: b^ expert, to support specific diagnose, to 
thereby avoid common pitfalls. 

the pathologist place, the specimen on a network 
in practice, the patho g ^ 

linked -«-"7^;'/,^„%,<,„ the Hospital Information System, 
demographic i"'"™"'"" algorithm, to help direct the 

.he DOSS P'-»";„7,rrf the specimen. The precise location 
microscopic .p.,,„en identilied by a 

, ratXi:n, d'etermined by the encoder with programmed 
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instruction and saved for future relocation. Additionally, 
images of the specimen captured by the CCD camera, are compared 
alongside images of proven cases in the DDSS database. These 
specimen images may also be incorporated into a pathologist's 
report and saved into his or her ovm database and used for 
future reference. DDSS algorithms identify a "most likely" 
diagnosis based on the pathologist's input into the diagnostic 
algorithm, the program then is able to make recommendations for 
further diagnostic pathology testing and to provide up-to-date 
medical references. 

As shown in Fig. 1 a PC computer 4 is interfaced v/ith a 
microscope stage encoder. Encoder interface boards are 
commercially available (e.g., TechnologySO , Inc.). With 
appropriate software a PC computer, operating under Microsoft 
Windows is able to perform encoder . functions using encoder 
generated data or data from the encoder system network 2 . The 
PC computer based encoder (encoder DS) 4 is connected to a 
microscope equipped with a CCD video camera 8 arranged so that a 
microscopic field can be viewed or imaged into the camera. The 
video camera in turn is connected to a commercially available 
frame grabber board in the PC computer (e.g,, from Hauppauge 
Computer Works, Inc.). Appropriate software provides for the 
additional functions of generating a report, form 9 of Fig. 2, 
which can be electronically stored or printed. This form 
contains encoder data including the annotation map 10. A 
reviewer is then able to find cells on a slide by moving the 
microscope stage until a visible cursor 11 on the annotation map 
is coincident with an annotation mark such as 12. Annotations 
for various types are differentiated by different colors, not 
visible in the black and white rendering of Fig. 2. When the 
cursor is within a preset distance from an annotation, the image 
of the microscope field is made to appear in a window 12 on the 
computer monitor and the annotation number in the area 13 . To 
do this, software was written to utilize the frame capture 
capability of the frame grabber board and the manufacturer's 
display software. Superimposed on the image is a button 14 
which can be pushed using the computer's mouse to store the 
image in computer memory. The user is able to indicate the 
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»b1e=tive used by clicKing one of Che buccons on Che 
microscope objeccive u ^^^^ multiple 

p„.l 15 with '•'^"°""^,J^;,rc focuses c« cbe microscope .c 
i..ge. Of any field " ,^^.3 are scored end 

of Che ""-''"""f^^ eppropriece software instruccion. In 
appropriately indexed wich 'J^JJ ,<r>ipped -ich a 

. preferred '-^^'^J'^J^ ZIH J toous posicion as i»age. ere 
„e=h.nis» CO -"""-f \^^,,„ „^ i„„e c.pcure i, Chen 
being capcured ""^^ clicking Che ».« Field buccon 

repeaced £cr each "-'"^i"" J„,,,„,a by ClicKing Che Hexc 
" or a differenc = '^'^^ ,,„p„cer records noC 

Slide buccon. IC IS P ^^^^^ conc.ining images of Che 

only "ich encoder daca, o possible Co include 

cells causing che »— "^^^ ^^.'".Ld. for vocally 
aacabase fields ^„ „„ be i^pl.^enced 

commencing on cells or Ji . .mailable PC compucer sound 

„,,b Che addicion of » ^ — ^"^^^^ ,„,o .he dacabase. 

card and software to place rec 

Tifin 3 The patient's 
, .urcher Kep^cing «J;;;;-:JZ^^:: " « [",T 
eccession number " .„„oc.ci=ns found on Che slide 

20. ac which cme ''^'J;"" „ .nnocacion number, all of 

. eppear in box 21. /^^^^f/",^, .ranaf erred from di.k .cor.ge 

tb. images of chat slide £"1^ » ,i.„i„g. The u.er can Chen, 
,o R«. scorage for i""""""" J"ts!ng Che buccons in Che 
„i.h a mouse, select a J„p .nd down focus 

field 22 and a focus """^ „i„aow 24 Che 

buccons 23 CO :icro.cope field, window 1, 

.ppropri.te image of Che anno cytology diagnosis 

elso provides Text of any histology don. on 

and 26 for l.cer typing ^"J^^'f^^ll „ports may be given 

the pacienc. concurrence of chese ^^^^^^ ^^^^^ ^^^^ 

' """*n"iU:r'for" ach "lide for use in labor.cory ^ality 

text and images i-^-^ 



control 



^ instruments, hematology analyzers. 
There are least four cypee »^ ""^-^^ „«puCyce USC- 
P.P smear analysers ima^e ,naly« ^^^^^ 
,„,demar.^ l.aer scanning _y^__^ ^^^^^^^^ 

are scanned, tne 
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digitally located and isolated and the cells are characterized, 
baaed on the scan data. One or more of the instruments can be 
interfaced with at least one of the microscope stations on 
network in accordance with the present invention. 

With each instrument, the cells can be classified and their type 
atnd location on the slide recorded in a digital medium. The LSC 
(5 of Fig. 1) is an example of a scanning instrument which can 
be connected to the encoder system network 2 by inserting a 
FASTCOM network card in the LSC's PC computer- The LSC can scan 
slides stained with fluorescent dyes to measure the constituents 
and morphology of cells on the slide and generate a computer 
database file containing a set of constituent values, morphology 
values and slide position values for every cell found by it on 
the slide. The position coordinates of the LSC can be 
calibrated to the same positional frame as the encoder system 
devices using a calibration slide, as described in the copending 
application. 

Slides to be examined with the LSC are often made by touching a 
surgically resected tissue to a slide or they may use tissue 
sections fixed to the slide. They therefore may contain normal 
as well as pathologic areas corresponding to normal and abnormal 
areas of the original tissue. It is advantageous to indicate to 
the LSC, by visual observation, the type of cells in each area 
of the slide, or to mark specific cells prior to scanning the 
slide. For example, a specimen may contain many more normal 
cells than cancer cells and if all cells were scanned, the 
resulting statistics may hide the characteristics of the cancer 
cells. If only the cancer area were scanned, the resulting data 
is more useful in determining treatment of the cancer. 
Accordingly, the slide is placed on an encoder DS , connected to 
a phase or fluorescent microscope. Cells on the slide are 
viewed and the stage is moved to specific areas of interest. 
Corners of the slide area to be scanned are annotated or 
specific locations on the slide to be scanned by the LSC are 
annotated in a fixed area centered on the annotation position. 
The positional frame of reference is translated back to that of 
the LSC. The LSC itself already provides the slide area and 
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well as on the LSC. 

-v,*. X and Y axis movement of the 
in an enO^diment ^^^^"^/^^^ ^^.o^er can automatically 

microscope stage - 3lidc review process 

relocate events of ^'^'^^^ ^^^ing the screening 

Which haa .een ^^^^ ThLefor possible in order to ease 
p„eess. Effxc.ent revxew „. ^ particular, 

the h^avy burden ^^^^^^ Che type of event, i.e.. 
events to he — ""J^ ^J,,, /...owed by all acypicals. 



all positive events 
etc . 



4r=>tn-i 1 iaritv of users with 
Xn addition to motorization, for ^--^-^^ ^.^^ ^3„,3lly 

normal operation, the f "^^^d /.^geTo.ion mechanisms used 
controllable through the ^--^^^^^^^3 by means of a dual 
in normal microscope .^..^er is mounted on the 

concentric shaft ^^^f/;,^ J^^^,, similar to those of a 

n,icroscope and equipped with a ^^^^^ ^^^^ encoder 

standard microscope^ direction sense so that the motorized 

generates pulses and the ^"^^ ^,,ion of the inner 

stage is made to move ^ .^^ ^ motion of the microscope 

^nob and encoder causes 2ZlTloJe or pointing tablet 

rrprrie:ric:%:n aose. .ay be used to cause 

(Gl idepoxnt^ , 

slide movement ^^^^^ ,y3tem and the 

It is understood that the construed as 

various preferred e-^^^-^^^J^/^^^..^^ ,nd that features and 
limitations of the ^^^^^^^"^ departing from the 

changes in the t em may be -de w ^^^^^ _^ ..nowing 
scope of the present xnventxon as 
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1. A method for network reviewing of a specimen slide and 
the manner in which a prior microscope examination of the 
specimen slide was conducted, wherein selected details of the 
specimen of the specimen slide and the manner of examination 
5 thereof were computer encoded, during prior scanning examination 
thereof with a microscope having viewing means and a moving 
slide stage, on which the specimen slide was mounted, wherein 
encoding of the details of the specimen and the manner of 
examination thereof was effected by: 

10 a) operatively linking computer means, with correlation 

movement sensor means « to the movable slide stage of the 
microscope, to correlatlvely record movement of the slide stage 
in an x-y direction plane in which the slide stage is movable; 
b) recording movement and various locations of the slide 

15 stage during the microscope examination of the specimen slide, 
at various locations on the specimen slide, by means of the 
linked computer means, pursuant to programmed. Instructions, Into 
computer storage means; and wherein the computer means, pursuant 
;fco additional programmed instructions and an internal clock of 

20 the computer means, automatically recorded, into the computer 
storage means, at the stored various locations, pre -determined 
indicia at predetermined time intervals, determined by said 
internal clock, with said indicia correlating to the microscope 
viewing area location on the specimen, at the predetermined time 

25 intervals; and wherein said indicia, correlating to viewing area 
locations of interest were optionally marked and recorded with a 
distinguishing marking for subsequent review recognition; said 
network reviewing method comprising the steps of: 

a) causing the computer storage means to be independently 
3 0 accessible by at least two separate microscope stations in a 

network, each of said stations comprising a microscope and 
computer viewing means, with each of said microscope stations 
being separately individually linked to at least one computer 
means capable of recalling said stored movements, locations and 
35 indicia from the storage means for review on the computer 
viewing means : 

b) recalling, at one or more of said microscope stations, 
from said computer storage means, a computer generated image of 
a slide with said indicia thereon, onto the viewing means of the 
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for review of the manner in which 

conducced; and cites of interest have been 

if indicia correlating to sites 

marKed with a distinguishing ^^^^^ 3t^ge of 

P-cing -r^tr—pe station, with the 
Che ,Lther operatively linked with the 

microscope thereat "^^J ^.ovement sensor n,eans; 

computer means, concomitant specimen slide 

ii, moving the stage wi ^^^^^^^^^ microscope viewing 

movement, wit. -/^/^^J^/^re: .enerafed image, .y indicator 
a.ea with -^^^^^^^^^.l^./.^Lcia having a distinguishing 
means, whereby viewable with the microscope, 

marking '^^^^^^^/^^^t "tworK reviewing of a specimen slide and 

2. A method for networ ^ ^^^^^i^ation of the 

the manner in which a ^^^^^"'^"J^JJ^ selected details of the 
specimen slide was ^tt^^^n^the -nner of examination 

specimen of the specimen slide scanning examination 

examination thereof J^'^^^^^p,,^;, ^eans . with correlation 

a, operatively ^^^^^ 3,ide stage of the 

movement sensor -^^^'J^X^,^^^^ movement 9* t:he slide stage 
microscope, to correlat ively r _ . ^^^^ movable .- 

in an x-y direction ^'^J^^^l^^ltiou^ locations of the slide 

b) recording movement and ^^^^ specimen slide, 

stage during the microscope ^^^--^^^.L^V ™eans of the 
at various locations on -^^J^J^ programmed instructions, into 
linked computer means. ^^^^^^JJJ J, c.„p..er means, pursuant 

computer storage instructions automatically records, 

CO additional programmed instr ^^^^^^ ^^^.^^^ 

into the computer storage means ^^^^ ^^^^^.^ correlating 

, locations, pre -determined specimen, and 

to the microscope ^^^^^"^ viewing area locations of 

wherein said indicia. ^^'^^^^^ ^ ^.^^ ^ distinguishing marking 
interest were marked and re network reviewing method 

-.-eview recognition. &«»■«- 
for subsequent review 
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comprising the steps of : 

a) causing the computer storage means to be independently 
accessible by at least two separate microscope stations in a 
network, each of said stations comprising a microscope and 
computer viewing means, with each of said microscope stations 
being separately individually linked to at least one computer 
means capable of recalling said stored movements, locations and 
indicia from the storage means for review on the computer 
viewing means : 

b) recalling, at one or more of said microscope stations, 
from said computer storage means, a computer generated image of 
a slide with said indicia thereon, onto the viewing means of the 
respective microscope station, for review of the manner in which 
a prior microscope examination of the specimen slide was 
conducted; and 

i) placing the specimen slide on the movable slide stage of 
the microscope, at the respective microscope station, with the 
microscope thereat being further operatively linked with the 

^computer means, by correlation movement sensor means; 

ii) moving the stage, with concomitant specimen slide 
movement, with correlation of each sxibsequent microscope viewing 
area with indicia oh the computer generated image, by indicator 
means, whereby correlated indicia having a distinguishing 
marking thereon is directly viewable with the microscope. 

3. A method for network reviewing of a specimen slide and 
the manner in which a prior microscope examination of the 
specimen slide was conducted, wherein selected details of the 
specimen of the specimen slide and the manner of examination 
thereof were computer encoded, during prior scanning examination 
thereof with a microscope having viewing means and a moving 
slide stage, on which the specimen slide was mounted, wherein 
encoding of the details of the specimen and the manner of 
examination thereof was effected by: 

a) operatively linking computer means, with correlation 
movement sensor means, to the movable slide stage of the 
microscope, to correlatively record movement of the slide stage 
in an x-y direction plane in which the slide stage is movable? 

b) recording movement and various locations of the slide 
stage during the microscope examination of the specimen slide, 
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elide, by means of the 
various locations on -^;/;;;:Vog/a™ned instructions, in.o 
linked computer ^eans. P^""^^'^^^,/,^, computer means, pursuant 
computer storage — ' /"^^^^"Lns automatically records, 
.o additional programmed -^^7/",„,,^,,ion relating to the 
into the computer storage ^^^^ reviewing method 

stored various locations ; said 

comprising the step of: ^^^^ independently 

causing the ^^^^^^IIJ^IZ.^ microscope stations in a 
accessible by at ^^^f comprising a microscope and 

network, each of ^^^^^^H^'^^'l,,^ microscope stations being 
,,^p.,er means. ^^^^^^^^^^^/^ at least one computer means 
separately i-^^^^^^^^'^^ '/^tlred movements and location 
capable of recalling -^^/^/^^^^^ review at a location 

information from the ^^^"^^ ,^ original examination, 

remote from the ^ "!"^,^,,ein the location information 

4. The method of claim 3. .^^^.a^es by shades of 

comprises a ^-^scale display, i^.reasing dwell time during 

increasingly darker ^^^^^ I, ^^^rlap of viewing areas and 

t.he original ' /^^"ewing area, whereby the degree of 

proximity -;-;r;;;.;L:mination may be determined . remote 
efficacy of the ony 

location- 3 ^Herein the separate microscope 

S. The method °\'=];'l'^^^^^^ lin,,ed to a hospital HIS 
stations are further -^^/-^^^^^^ ^^ans are made to provide 
system whereby the computer vie^^^g^^ ^^^^^^^^ , 
simultaneous slide analys ^^^^.^^^ ^"""f 

history of a P-^-/%'"",^,^ 3. wherein areas on the slide 
6. The method of claim 3. during said 

..a.ions a.. -^^T^'t^'iLeby ch. video area, 

^„ow„ aliae •P-""'" .pecimens in a aide t,y »id. 

,5 are vLoallY cowared to Kn 

cotoparlaon. wherein at leaat one of the 

e. The »«thod of -l""/', ,„„^„ independently linked to 
--""o:t"cruT„.ryrrn,tr.»enta, »her..y ceU analysis of 
one or more cexj- 
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Other specimens from the same source as the specimen of the 
prior microscope examination, is effected by the cell analysis 
instruments and wherein the analysiis data from the cell analysis 
instruments and the results of the prior microscope examination 
are simultaneously available at the at least one of the separate 
microscope stations, for review thereof. 

9. The method of claim 8, wherein cell analysis instruments 
are at least one of a hematology analyzer, PAP smear analyzer, 
image analyzer and laser scanning cytometer. 

10. The method of claim 9, wherein the instrument is a 
laser scanning cytometer. 

11. The method of claim 3, wherein at least one of the 
separate microscope stations each have microscopes with motor 
driven stages, with computer control, to re-scan slides or slide 
images only at viewing area locations of interest which were 
maz-ked and recorded with a distinguishing marking. 

12. The method of claim 8, wherein at least one of the 
separate microscope stations provide at least: one of anatomic 
pathology and cytology diagnosis reports to a central Hospital 
Information System, where a permanent record thereof is 
generated. 

13. The method of claim 3, wherein during said prior 
examination, multiple images of selected fields ^ at different 
focuses of the microscope and at any of the magnifications are 
stored and indexed, and wherein microscopes at the microscope 
stations are equipped with means to automatically move a focus 
position as images are being captured, stored, and recalled. 

14. A network of interconnected microscope stations, with 
each station comprising a microscope operatively linked to 
computer means wherein information relating to a slide specimen 
being examined by the microscope is stored by the computer means 
and is thereby made accessible to other microscopes and computer 
means at each of the interconnected microscope stations . 

15. The network of claim 14, wherein each of the 
interconnected microscope stations comprises a terminal for at 
least one data base having information relevant to appropriate 
examination of the slide specimen. 

16. The network of claim 15, wherein the data base 
comprises a Hospital Information System and wherein the slide 
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.n .he Hospical -^^^^^^^^^air" wherein selected areas of .he 

17. The network of ^l^^*"^ digitized images by 

slide specimen are ^^.^ i,,ges being accessible 

conversion and -""f J^/J^,,^, 3.ations and vherein the data 
at the interconnected ^---^^ ^^^^ ^^^^ ,,,own slide 
^ase further includes^a ^^^^ ,,,,3 are visually 

specimen images whereby ^ ^^^^ 3,^, comparison 

compared to known slxde sp interconnected microscope 

on video display means at any 

stations. wherein the network further 

X8. The network ^{ f^^.lvsls instrument and wherein at 
Includes -/-:\:::;r;nrted'microscope stations comprises a 

- ^^^^ ^^"^"^ 

--—he network Veratro;srr:rer^ro:prisr ^^^^^ .or the 
--™^:raTerort into tL Health Xnformation System for the 
r-rnr o: s...^ specimen examination. 



22 

SOBSnrUTE sheet (rule 26) 



wo 97/25678 



PCTAJS97/0074« 



Figure 1 Pathfinder System Network 
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